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ABSTRACT 



1 



This volume provides a technical summary of research 



condlicted at the West Nev York (Nev .Jersey) Adult Learning Center 
vith adults in English as a second language classes. The study. vas 
conducted in order to determine the relation of .teaching^ strategies 
and performances to the acquisition of skills in s{)oken English. 
St udeat , proficiency was me^^sured,,.at two points in time, and tiie 
intervening .instrujption ira^ measured daily. Measures of s[$eaking 
facility were either direct measures, of proficiency, 'such as the Oral 
Proficienc'y TestlyABVBlp]^ei specifically for.thii^ project, or were 
other measures o£<\knowl'edge of Engli^'h^ Classroom observations 
prpvided a conti^buous recor^of both teacher and stjudent beiiavior^ 
daring class ^se^ssionsf and between the two tests; assessing the"^ / 
• students* sneaking * prof icienc]^.^ Factor anl'lysils and c^anonical- 
^ ^istfriainanty f urictioii analysis were used t,o reduce bqth 
s4:u^ent-per.formai&ce data and- teacher** performance- datdl to their 
underlyin^f ^ii^nsions." Multiple regression, canonical co;:relation, , 
apd^f actor analljrtic methods .were used tO; t relate the dimensions of 
t^cherlp^rfor[toaiice to those of student performance.^ This stud^ 
Vevealed the, interactions among student ciiaxacteristpLfesv initial 
proficiency, classroom interaction patterns, ^and filial achievements 
Til e, classes, with higher achievement fell into three dist^Lnct groups 
^which ttsed different methods 'of instruction^ and whose ..students 
-^^Jiar^d similar i^adk^round' characteristic (Author/Hy) 
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PREFACE 



This repojrt describes a study of the teachers and students in the 

-/'■', 

West New Yo^^^' Adult Learning Center. The purpose of tfie study was to. find 

out which .i^attems of classroom interaction and students' -characteristics 

/ 

were^ in^st highly related to the acquisition of oral proficiency in English 

y ' / / ^ ' ' 

by /d^iuyts who were learning English as a second language* 

f^his volume is a summary o§ the Final Report, of the research conducted 

at the West New York Adult Learning Center, and appears in two volumes. 

Because the Final Report^resents detailed and complex statistical analyses, 

,we have prepared this executive summary which describes the purpose, methods' 

^ and^ results of the study with the basic statistical 3ata. Readers interested 

in the details of the statistical analyses may send for the, full- report. 

We wish to express our appreciation to Arthur Von Schalscha, Director 

of Continuing Education, Kathleen Dumin, Coordinating Teacher, Mariluz 

Garcia and Robfert Layton,' Tester-Observers, Diane ilappucilli, Secre^tary, and 

* . *' * ' 

the 12 participating teachers for their assistance _^^nd cooperation. 

We also wish to thank Joanne Farr for her dedicated and outstanding 
performance as Project Secretary.. 
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INTRODUCTION 



. ' K > , 

The West New York Adult Learning^ Center provides a training program in ' 
which adults learn to speak English 'as a secorj^d language. This repoi^t describes 

the research conducted daring the l^yS-zfe*; schopl year in the West -New .York Adult 

. ^ ' ' ' w . , ' , ■ 

Learning Center to dete'rinihe the gelation of teaching strategies, methodologies, 

and performances to the acquisition- of facility in speaking English as a second 

language. » The methodology used in the study related differences in teaching 

styles and performances among the teachers to differences ,in the acquired 

proficiency of their students. , ^ 

» The general methodology used in the study required us to measure student. 

proficiency at two points in time, and to observe daily the intervening 



instruction. Th^ measures of speaking facility were either direct measures 
I pf' proficiency , sucji as the Oral Proficiency. Test developed specifically^ for' 



this project, or were other measures of kiiowledge of English. The observations 
provided a con'tinuous record of both teacher and student behavior * during . 
class sessions and w ere made between the two points of assessment of the . 

students speaking proficiency. • " ^ , 

• \ . ' •* 

Factor^analysis and canonical discriminfint function analysis; were used 

. to reduce both-s,tudent-performa^ce data and "teacher-performance data to their = 

underlying dimensions. Multiple regression, canonical correlation:, and factor 

« * 

analytic methods were u^ed to relate the dimensions ^of teacher |)erforinance to 

>- ■• ^ - . • • 

those of student performance. * <»' 



•THE MEANING OF PROFICIENCY' IN SNEAKING ENGLISH 



The operatipnal definition of proficiency used in .this study'was derived 
by an analysis Q^f the goals of the West New Yark Learnirig Center* These 
goals are to facilitate, the acquisition of .English as a second language so 
th^t: (1) the adult learners can undjerstand conversational English; - (2) they 
will be able ,to conunun;Lcate .in English iu ordinary situations so that tKey 
are adequately understood; and (3) they will acquire the basic structures of 
th^^ianguage so that th*^ ^re ^likely to continue to grow in proficiency. 

Th«ee levels of performance in speaking English .may be distinguished. 
The first level is acquisition of the language such that the person understand 
ordinary communications to her or him; for example,' a person is asked simple 
questions such as occyr in everyday conversation and is able to understand 
the question being asked even though they cannX)t always proYide a full or . 
accuTa^te answer. ^ . ^ - • . ^ ^ ' ^ - 

A second level of proficiency is represented by the learner being able . 
to respond to questions or to makfe statements about himself or herself, what 
they plan to do, what they think on practical" matters, and the like* To 
communicate at this level, a person must have acquired the basic structures 
of the English language* , . - * / 

A person has attained the third leVel of proficienc^y \^hen he pr she can 
generjite question^/and statements on his or Her own, can extend discourse 

througli a serj^^^^f statements or questions, and in speaking uses more complex 

" , / : • * ' * . \ - ^ 

structure's^ \ ' ^ 

,^a^,of these levels of prof iciency^may haye one or ,rtore of three 

ra'cterlstics*: (1) the person spoken to may give evidence of understanding 




the language spoken to him but does not respond with facility or acc^iracy or 



' 'completeness; '(2^ the pferson may both understand and use appropriate structures 
but ma^make errors in the use of the -language; , C3) the person iJiay both under- 

^- ' . • . ^ 

A^., Stand and 'respond with appropriate structures- and use them accurately. - 

Thus, there are two underlying conpe'pts by which proficiency has been 
described. Ofte of these concepts describes the level ^ of language usage , ' 

available to the individual. .On this dimension perfprmance ranges, from' , 
\ svfficient usa^e to comprehend wkat^^is being'^heard to the ability to generate 

T"' rSlativeiy cbmplex^ structures" in extended dif^course. ' " 

The other dijiension is that;^ of. the accuracy of the form of the cotamunlcatio 
-<Accuracy means 'that a person uses English sentei^ces o^hich ar^ structurally 
c'o^rect and (by implication) has also used words -Correctly. 
- ' " The West Ne\/ York Adult Lemming Center 4efines the kinds of structures 

that are' to be acquired at eaqh level of instruction. The acquisition and 
uae of these structures defines operationally what is meant by proficiency. 



THE MEASUREMENT OF TEACHING PERFORMANCE / 
In this study we were concerned with how teacii^rs teach En^li,sh as a 

•-^^ • ■ ■ ■ 

second language. The word^i^s^ow they teach," imply that we 'wanted an 
accurate description of how the teachers organi^efd the classes for instruction,^ 
what materials they used, how they ihte^racted ji/ith the students, and the 
content- that ,tbey .taught. We assigned observers to make daily observations 
of each of the ^teachers in the. classes of tfie Adult Learning*. Center* , 

.•The method of observation was developed by observing the teachers for a 

^ . period of several months. The purpose of these preliminary observations was 

' ' ^ , . ^ ' ' ^ ^ I. • 

to familiarize ourselves with "how the tedch^rs "taught. A. category^ system 

V\ which describe^ the^. teaching^^ac^tivities was constructed from this ]^informat ion. 

' • \ ■ ■ \ . • . ^. " 

ERIC ' \ ■ ' . ^ 



This category system was -then' tried out syste^ktically and f^u^ither refined. 
The final product was a ^et v5)f% categories and a method for observing that 
provided descriptions of the activities typically occurring in the classrooms. 
The observer checked continuously those categories which d^escribed what the 
^efachers and- ^students' were doing. • , ' / . * 

Theoretical preconceptions did^not (de terminer, what wfe should or woilld 
observe in a* class, ^ The categories, ^however, do include descriptions of 
teaching uerformances associated with ^two different theories of language « 
instruction because"- bfeavior, relevant to the© had been observed in ,the 
classes of *the Center, These two. methods are. the audiolingual and the 
"silent way," ^ ^ , * 

. ' Since »these two methods are used by, different teachers in the Center, 
the category System contains categories to fully describe either method. It 
is possible, therefbr^, to sftidy three problei^s ; (1) do th'e teachers adhere 
to. a method (such as the audioMngi^al) or do they vary' among themselves in 
^GW th^y use it;, (2) is there any^evidence that' one method ■ is^ore effective 
than another, either for all students or .certain 'kinds of students; (3) are 



\ 



there elements in either method which are particularly effective 

' ' THE SA14PLE OF CLASSES STUDIEI>"^ . 

* The students in the Adult Learning Center ranged .in- age from 19 to 73, ^ 
The^majo^ity of the students are immigrants from Caba; most of the other , 
students are from Caribbean and South American countries, so that the native 
language of over ^0 percent of the students is Spanish, . * 



/Both day and evening classes were studied; h^ever,' the most inform^ive ^ 
results came from p\ie data collected on the day-school classes and th^i;e£ore 
it is this sample thaf is described here, . "For a cotpplete. report , contact^ 
the senior author, . • ^ • ' : ♦ ' 
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There were 14 day-school classes taught by six different teachers yhich 

V ^ ' ' ' ' . 

were studied in this researwch jroject.* 'The majority of classes in the" day 
school of the Adult Centner- met for an hour-andr-a-half a 'day,^ five days a. 
" .week** • < . ' ' ^ ' ' 

Table 1 presents .the data on students who were in the Center during 

■ ~ ^ *'= . . ' > ' ■ ■ ■ • 

the entire period of the st^dy from November to June. A comparison was 
^made between the" original sample of sttlS^ents present in the^ Center in 
November, and the sample remaining^n June. "bJo significant differences 
• bfetwe^n the two samples were, found. • . 

As can be seen by scanning Table 1, there were more women among the 
day-school student^ than 'men, more did not have a h^gh-school dipLotfta than/' 
had one; the itfean ^ge was approximately ^ 46 yeai^s and the mean level gf [ 
education attained wasv about that of the tenth grade. Oa the.^yera^e, 
Students had been in. this country sixi years and had stud*ied Eraglish in their 
former country afid in the -United States on the^ av.erage for about one year. 
The occupations held^by the students in their country of origin and in the 
Unite^d States were mai«ily lower middle class' and lower class occu^jations, 
J;hough ther.e were a number of students who had had professional occupations 



in their former country. 



'^Teacher Char^cteris tikis 



The Ueachers f ille'd- out a questionnaire* asking for the following 
inf ormatloTi*: agefs^^^x,; undergraduate institution; undergraduate major; 
gradua'tM institution; gr^uate raajor(s); number of cr^edits completed; 



degree([s) completed; number, of years teaching; - grade J-e-v:^ oF^te^ching 



experieiw^ number of years teachjing JESL 'part-time (to night*-schoOlw adults ) ; 
numbet of years teaching E-SL fpUL 



•time to children,* to- tee|i§^, to adults; 



■ft 



TABLE 1 ^ 



Years of English 
Studied in U. S* 

Mean Years 

Range 

Country ^of' Origin- 

Columbia , 

. Cuba ' 

^ Domiriican R. 

Ecuador 

Peru • , , 
» 

Other 



1,17 




0-3,0 




3 




73 


90 


1 


1 


1- • 


1 


G 


0 




' 4 



Day. School Student 


Background Information 
- . 


— Descriptive Statistics 






Total 


Preq, by Level ^ 




Preq. Percent 


r 


' .2 


' 3 




^ ft! 




• 28 


29 • 


Sex: M , - . 


26. 32 


9 


13 


4' 


P 


. 55, 68' 
• * 


15 


- V 15 


25 


Diploma: Yes 


. \ 32 .AO. 


Q 
O 


lU - 


lA ^ 


Ko 


.49 '60 . • 


16 , 


18 


15 


Age ; Mean 


A6 


48 


. 45 


45 


Range 


19^70* ' 


' 21-69 


, 19-7^ 


24-67 


Education: 










Mean Years 


10 • . 


9 


/ ' 10 * 


11 


Range 


•A-16 


' 4-J6 


4-16 
• 


4-16 


Tlflie in -U. S» 






/ 




Mean Year^ 


6 ' ■ 


6 


6 


7 


Range 


1-2A^ 


1-15 


1-17 


1-24 


Years of English i. 










Studied • in 










^brmer Co up try 




. ^^83 






Meart Years 


/ 1,17 


. ,75 ' 


^l>8-3 


Range 


0-12 


0-5 


0-2 • 0 


.Q-12. 



• 58 1,25 0 ' 1,50 - 
\ 0-1,5 0-Z.5 0-3-.0 



1 
22 
0 

i 

0 

a-. 



.2 
25 
0 
0 
0 



26 

r 



Occupation 



ceup 



Po reman 
Craf'tsman- 
3." Simi-skilled t^orker 
4* Laborer 

5. Hoysehold Worker ^ 

6. ' Personal Service 
7» Pinfman/Policfeman 
8. Professional 

. 9. Technician 
10.' *Parraer 
11.. Parm Worker 

12. Business Owner 

13. Managef/Of ficlal 
^14. Office Worker 

15* Salespersonr ' 

16. Hou55ewife . • 

17. Unemployed 

18. Student 



. 0/0 
' 1/0 

6/20 

0/0 

0/0 

2/7 

0/1 • 
23/1 

4/1 

0/0 

1/0 

:/o 

1/1 
19/7^ 
4/6 
13/17 
P/19 
6/1 



0/0 
1/tf 
4/4 
0/0 
0/0 
0/2 
0/0 
5/0 
0/0 

6/0 

1/0 

1/^ 

0/0 

7/0 

1/0 

3/5 

0/12!^ 

1/1 



0/0 
0/0 
^2/7 
0/0 
0/0 
2/5 . 
0/1 
8/0' 
I/O- 
0/0 
^/O 
0/0 
1/0 
6/4 

1/3 : 

4/2^ 

0/6^ 

3/0 



• 0/0 ^ 
0/0 
0/9. 
0/0 / 
, ^0/0/ 
'0/0/ 
X)/Q ^ 
10/1 • 
"3/1 
0/0 
0/0, ' 
Q/0 ^' 
Q/1 ^ 

, '2/3^ 
^ 6/10 
r 0/1 

z/0 



^ it 



*Prevlous country/USA; e.g;, f«hcre were 23 sttidpnt^s uh6 were prof essian^*l6 tfi 
their country of origin; but only one was a professional at the^ ti^pe of this st 

^" Level": students are assigned to tliree instructional levels o'rv^h<Ki)asi^ of 
their proficiency in speaking English whcn-they enter thc'^Centc'r. • 



number of ESL seminars;, number of ESJ. workshops; usefulness o| undergraduate 

experiences; usefujj^ness of graduate experience; usefulness of ESL seminars 

and workshops^' percent of beaching 4^hidh is audiolingual, silent way, and 

Other; and a statement describing their teaching methods and philosophy. 

The majority of teahers were women4 All* six teachers had completed some 
' ' * , • . * * •< » ' 

graduate work, three had>Qompletiec} a Master *s degree and one was working 

on a second^ degree, ^ter^t of the teachers' experiejice Vith English as^ a 

* ^ ' . N ^ ^ i V * - ' • * ' 

Second Language (ESL) had 'been "teacTiin'g" adults. 

Only ^ two teacher:s said they used tHe^ audiolinguaX method of teachii;ig * 

and estimated that 60-65 percent of their teacte.ng was of this kind. The 



majority of the teac^hers 'stated that they believed that teaching styles 
should be eclectic and tha-t stude^t^ should domi&te clas^obipt. interaction. 

- THE MEASURES "OF STUDENT PROFICIENCY IN ENGLISH-' \ ■ , 



The measures of proficiency in English were administered at two .different 
times: ' in^Jov^mber and 'agai^during April' an<J Ilay^ . fh'e first test^ mieasured 
how profi'cient the students .were ^'ear the beginnirig of -tKe"*xnstruction that 
they were receivings that year; the, second ,test measured how prof icient ^they 
had become after^six months of ihst;t:uctiot 



The Oral Proficiency Tefft 



;* -.The first, step in developing the 6r^l Prof iciency. Test was to gather 
from t|ie teachers in the Center a list of objectives for each of th^ir „ ,y 
classes. Each teacher provided iO object:5ves and a composite list of 132 



o'bjectives resulted* These 132 objectives were t>ien given to the teachers 



who rated each objective on (1) whether or not. it was something th'ey taught; 



(2) 



important they, felt it was for proficiency; (3) how muchx emphasis. 



'they gave, it in their ^:lasses; and C^) how difficult they thought it was to 
leamy These objectives and rating were then used t;o develop the content 
of the ,Ora^ Proficiency Test^ , " . • ' 

The Orai Proficiency Test as an individually .administered 60-item test 

't^at required the 'student to >peak In English, It had three kinds of item^ 

The first set of itepis'were based on representative examples of the teachers - 

: / . • \ ^ ' • '^^^ 

objectiyes for each .levej. of p;rof iciency • . These^ items were in a striictured, 
conversational format and arranged in order of difficulty by , objective. The 
second type of item involved presenting the student with ap.tion pictures; 
the student was asked to des^cribie what was occurring in the picture.^ Both 
types of ^tems .tested theif student 's ability , to generate language freely. 
The third type of item consisted of three Spanish cartoons and *the student 
was -asked to state in English what was occurring in the cartoons. The 
purpose of this type of item was to see if the student could go from idiojpiatic 
Spanish to idiomatic English. ' ' ^ , . » ' ^ ^ 

One store on this test was for comprehension > ^[leaning that the student 
gave evidence of. understanding the questions asked of him or her but could 
not produce a correct English response..' The second score Was given for, 

I . ' ^ ; * 

. sej^jcting the appropriate 'StfUcture to use in a response even though the 
student made other errors in responding. 'The third score was for ' 
correctness as well as use of appropriate structures.^ ^ ' 



I 




' \ ' - The .Literacy Test '*«W4>, 



_ 'a potential side effect of * learning to speak Engl^iSh^s that students * 



% ■ . ■ . 

may al^o. learn 'to r^ad it. There:^re, we used a Litelbacy Test which ^i^asures 
the' :£unctional feeding ley^l^oJLtKe ^^ident. T^He .materials in the test 
.consist of pictures .of \^igns^, lables on bottles/ forms, tables and so on.* 
Ther^ were 50 such items in the Literacy Test adapted from an original set 

of 170 items which had been developed to measur'e functional literacy of 

■ ^ • * 3 . * ^ 

adults who spoke English. . ^ ' ' ^ - 

■ ■ ■ ■ ■ ■ - ■ ■ 

> . Aural Decoding -Test 

We thought that students might also acquire xjecoding skills as 4 resj&t 

A* 

of ' learning to* speak English.. ,A test developed originally to measupre t^*^ 
decoding-' skills of 5^oung children was adaptned and ^U'sed to see if the ^tudent 
were also acquiring decpding skills* 



Other Measures of Proficiency 

Two other measures of proficiency were used, the John Test and the 

'/ ' ^ 

: > » ' * " ' * ' I 

Morano Test^ The Celntfer/had been using both of these tests to estimate 




students^ initial prof^^p^ncy in order to place them' in- classes. / 

, Murphy, R. T. Adult , Functional Reading Study. Educational Testihg Service, 
Prii^cton, New Jersey / '^973. ^ . * • 1 

^ - ■" i' ' J 

Developed by Robert arid Kathryn Calfee, Stanford University ,^ for the 
Beginning Teacher Evaluation Study conducted for the Calffornia Co^ission 
for Teabher Preparation and Licensing ^by Educational Testing Service. 
.Frederick J. McDonald, .\ Project Director, ^jr • ' . • . • 
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, This oral proficiency test (developed by Linda Lunz of Hun-ter College) 

consists of eight pictures about which the student was asked 22 questions. 

The Student is given a comprehension score and is rated ^by the tester on • ^ 

fluency , use of structures , pronunciatipn and vocabulary ♦ ' " , • 

■ ' ' ' ' V - , ' 

Moranp^Test ^ " * ^ ' 

The MoranoJTest is a paper-and-pencil test of recc||nition of correct 

. u * ^ : * ' r ■ ^ ' ' 

,use of English grammar I It Has 50 4tems each consis^ting of three "sentences 

; ^ ^ . ■ • • . 

' . : /e^^essing the same idea but only one of which is grammatically correct;S 

=f Jhe student, is instructed to read the items, arid indicate the correct 

• , . - ^ ' ' ' • \ ' ' 

, sentence. This test was also administered as' a pretest. 



Sttident Pel?formance on the Measurers of'^Prof iciency 



Table 2 presents the data on these measut^s. Information is given 

\ 

for each test on the number of students takiitg^the test, their mean score, 
the range of scores, the" standard deviation of the scores, and the reliability 
of the t^ft ' / , — / ^ 



Description o£ the Observation System 



A categorical observation system. was developed which allowed for sequential 
coding, of classroom behavior. A copy of the Observation Coding Sheet is shown^ 
in Figure 1. . " \ ' ^ ' . ^ ' 
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. 'Three superordinate cate'gories — context (instructional design), materials, 

and strategy (method of insti^ucUion) — describe the classroom, setting within 

• ' "* . ^ ' ' 

i^hich the teacSier and student' heh^iors are recorded. Each of these categories, 

is subjiivided; e.g., the context^can be drill, writing, explaniition, 'dictation, 

,etc. i and eacli s'ubdivision has a. numerical code* , • ^ ^ 

^ The. first group of teacher behavior categories — questions, serial 

redirects, 'direction, models, writes on bo^rd, esfplanation,, and other — are 

discrete instructional behaviors which usually initiate, a teacher-student'(s) 

interaction* The ne^t coTumn — class, group, individual—signifies to whom 

this- behavior is, directed* ^ ^ . ' » -x. 

The first group .of student behavior categories — answers, free response, 

* • 

pract;Lce,*write5- on board, reads, chooses not to respond, ^sks question, 
participates in conversation, student-torstudent feedback,* ^d dther — are 
those* behaviors which either follow the teacher's iititial behavior or ^* . 

■ ■ . " - . A 

initiate an Interaction .on the part of the student* Convejrsation and student dj^ 
feedback are coded with an "S" if they occur in Spanish rather than English* 

The next three' categories — positive, corrective^ negative — describe' 
the possible types of teacher feedback* The second, group of teacher 
behavior categories — models, prompts, asks to repeat, repeats, explanation, 

. ■ ., ■ " ' .0^ ■ 

writes'.on board, direction, question, and other—designate response 

behaviors on the-part pf the teacjier. - ^- 

The second, group of stqdent behavior"' categories—studeht models,^ 
* * • ^ » - * 

student prompts (these two ^ usually follow a' direction from the teacher), 
answers," free response, practice, writes oi\ board, reads, chooses not tq^ 
respond, asks question, participates in conversation, student-tp-student 
feedback and other — describes those' student behaviors ^iven in response 
to the' teacher^ s response to the student's initial behavior, or response; 




The comment coXumn^allows the -observer to- indicate what* the > "other" * ^- 
"behavior coded on that line is or to' note some unusual classroom occurrence^ 

.1 ■ • ;• ~ ■ .-1 \ j^- ' ' •• • ■ 

^ ' . » ' U^e of the Observation System' ' , 'J . ' ' 

> ' \ ^ * ' ' ' ' 

• * A schedule for obser»vat ions' was prepare3*^hich ^ilowed'for a 2b-minyte » 
observjation of each class on^ four different days of the^^ week* For those V 
classes meeting onl^ two or three times ^ a week, observations were scheduled 
for e^ach meeting^ Observation of the classes began^ January 19th and . , - » . 



c^tinued through April 1, 1<976.' ' ^ ^ 
^ . ' * ' / ■ . ' 

Table" 3 »gives the observation item ^uinbef s , category labels, code's ^^^^ 

i ^ . * 

and meaas .for the 14 day-school^ classes observed. The category means are 

- -> ■ - 5 - ' ' ^ . . ' ' ■ ■ 

the proportion ^of observation episodes ^n .which the evefit was, observed in 

' the 'classes. These will, however, add to l.GO only ^hen the behaviors ^ 

within a group are mutually excliisive and exjiaystiue. * ^ / 



t 



/ ANAJ.YSIS OF THE OBSERVATIONS OF TEACHING BEHAVIOR . 

The .system of recording classroom behaviors emi>;Loyed^^in,'this study ^ 5 

yieided a 23Titem response record (see Table 3X' for each episode of interact^dn *r 
Ol^^ryed in the classroom. Each- auch episode be gail whei either-, the teacher. 
or a student initiated an interaction, anct C9uld .cj/nt£rihe through an e^tended^ 

' . ^ ' ^"^^ . r ' ' - > ^ ^ ' / ' ^ 

sequence of dyadic internihanges. The. participation of other students in the^^ 
barsic pattern of teacher-student interactions was also^ recorded.' Every 
interchange in ea^h sequence of interaction '(e^isod^) ly^s initially recorded 



'^An^ episode is defined" as a sequence of behaviors/between teacher ^ud^* * 
' any particular student. It may be initiated by(eit'h^r teacher or student ^ . 
and.ends when ^-he. teacher addresses or responds *t5>aft^rCner atudent. , , ' 



• ^ TABLE 3 - 
Item Cacegorias^ Ear Clas^roon Observacioh 



• ..Number o£ 
t "T^ 



CacGgory Labfils^ 



1 Context 



1 Dri^f 

2 Ocher 



' Codes 

DRILL 
OJHR 



Means+ 

.99 
.01 



2 Materials 



7 . 



1 .Ko ^^aCer^aLi 

2 Rods 

3 *Car toons 

4 FtcturSs" 

5 M^jf^eo Sheets 

6 Objeecs' • , 

7 Slgnt Wprds * 



.N6 MiXTLS 
RODS. * « 
CARTOONS 
PICTURES 
MIMEO ' 
OBJ^as 
SIGHTWDS 



.:53 
.11 
.02 
• 05 
.23 

.o:4 



3 -Strategy/Model 



1 Question & Answirs 

2 Free Responac^ 
"3 1^epecit£on^t'. 

•A • Picj^^ed iJialoguc 
' 5 DUt5>%ton'' 



fre£ res 

REPEAT; . 
DIRECfED 
DISCUSSM 



.94 
1-03 
.00 
.02 
'.01 



A Initial Teacher Behavior 
5 Initial Teac'ier Bdhavlor 
^6 Initial Teacher Behnvlor 
- v,7^^Wt'lal Teacncfr Behavior 



1 



2 . Question 
2 "Models ' ■ ^ 

2 Writes 'on Board. « 

/' .J 

1 Serial jledlrecC 

2 Direction • ^ 

3 E'xpl.intitlon 

4 • Oth^r <A 



— ?r-= 

jTBl--QUfeS'^ 

TBl-MODL" 

T31-:/0B - 

TBl'SR 
TBl-DIR 

tri-e:<p 

TBt-OTlIR 



• 32 
.10 

.05 

.01 
.13 
.di 
.03 



8 Object of TeAcher Behavior 



1 ^Cln'ss 

2 Group 

3 Inai'/ld^jal 



-A CI-\SS 
\ CROUP . 



.2T 

.01^^ 

.70 



9 Initial Student Behavior 
19 Inl'tlal Student Behavior 
31 Initial 5tudeat "Behuvlor 



« Z 
• 8 




22- 



2 Ansvcrs ^ 
2 Pcapt ices 

L Free "Response - ^ 

2 V::i:ftj.' on Doarc! 

3 ^ Read ^ ^ ' ' 

4' 'C^toosoa Noc tb^ Riisp^nd 

5 Asks Ouestlon - 

^ Conversation 

7 Studcnt-Studertt Fe^dlij^ck 

8 Otncr. ' . ^ v 'f* 



SBl-.Vi'SR 
•SBl-PRi\G^ 

•SBl-FREE • 
SBl-WOB • ' 
SBl^RfA^ 
SBl-CNof ' 

' SBl-AQ 
SBl-CO^fV 

sbi/sfbk' 

•.S31-0TUR 
l_k 



.11 

.09 

;oi 

.09 . 
..00 
.12 
'..01 
.0^2 
.02- 




?3 



TABLE 3 (Continued) 



Iceia 

12^ Cor receive' Feedback ' 
13 Qualtcy of-Feeback? 



' *t4umber of 
Cacegorl^es 

2 

4 



2 

' 3 
4 



Cacegory Labels ^ 
Corr-ecdvc 

OK ♦ 

Posiclve 
Negadve 
Ochpfi 



Codes 
FB-CORR 

BB-OK 
•FB'-POS 

FB-NEG 
*FB-OTHR 



Means-^* 

^ .50 

.07 
.05 

.(ML 
' .00 



14^ Successive Teacher* Behavlop 

'15 .Successive Teacher Behavior 

16 ^Succelsive Teache# Behavior 

17 Successive feache^ 35haviof . 



. 2 
7 



' xk Other "Scudenc Beh^vior^^ 
i9 Ocher Sci?denc B^avidr "^'^ 



2 

^ 2 

1 . 
2 
3 
4 
.5 
6 
7 

V 

2 

2 
2 



Models • 
Prompts,;^ 

Asksr Scudfetic^co Repeat ^ 
^epeacsv . 
ExpIaifaf|rion 
Wrices on Board 
•Direct loft 
AJLccrnace ^Response 
Ocher ^ • 

Question- 



TB2-Kpnr- 

•TB2-PR0M 

'TB2-:\TR 
*TB2^R£P 
TB2-EXP • 
TB2-W0B 
TB2-Dl,R 
. TB2-<VLT 
TB2-0THR 

TB2-iiUES, 



Student Models 
Studcat Prompts, 



S^2..SM0DL 
SB2-SPR0M- 



.22 

.47 

.16 

.04V 

.07 

.06 

.02 

.02 

.01 

.09.^ 



• 09 
.05 









20 


Successive Studertt Behi^^vioV 


, - 2 


2 


i\riswer? • ^ 


SB2-ANSR _ 


.75^ 








• ^21 


Successive Student Bebaviofc 


' ** * 
2 


t 


Writes on Board 


S^WOB ' * 


.02 








■ 22 


Successive Student Behav^oV 


■ a 


I 


Free Response 


SB2-FREE 


\ .02 














2 


Practices ^-^^ 


SB2-rRAC 


.22 










\ ■ -1* " .~ " ■■ 




3 


Rends* ■ \ . 


'SB2-READ 


.02 








* 


i 




4 


Chooses not' to Respond 


- ' . SfB2-CN0r 


.00 










1 




•6 


Asks Ouesdion ' 


SC2-AQ 


.04 ^ 














6 


Conversation 


Sn2-C0NV 


.QO - 














7^''5tudent-Studeat Feedback 


SB2-srr.K 


.04 
















0,tlv^-.' 


^E?-OTIIR 


.01 . ' 



23 Cbseryer Cotnnencs^ 



1 General Conn^'nt ^ * . 

2. Student Response' in Spanish 
*3 Teacher Action Non-verbal 

4 Backvards Buildup Exercise 

^ ^ Teacher^Reads 
^ 6 Teacjie;: Response In Spanish 



C1-CEN*LC 
C2-SRSPH 
C3-TA-4iV 
C4-BLDEX 
C5-READC 
^ C6-TRSPN 



7 Comment on Back of Surrtrnary . Sh^et C7-0THR 



.02 

.03 

• 10- 

.01 

.00 

.00 

.07 



jHca a number of occurrences per episode^ In most instances these nay be Interpreted as proportion of episodes in whl<;h the 
event was observed.. TKe'y will only add to^l.OOjwhen groups of behaviors are mutually exclusive and exhaustive* 

^ ' «*' " . ' ■ . ' * 

Binary Iteras are designated appropriately as havir\g two categories, but only the "behavior present" category *is labeled 
and' scored for a^nal/sis., ^ , • ' . • » 

Sone of the binary iteras whlth coulJ be repeated in rapid succession were siwply couqted Instead of talking a separatf data 
entry for each Instance. . ' ^ - ' ' ^ ' ' • 
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4^ 



^nd 'coded individually; these indivioXial instances weW, then Aggregated by 
summing tc^ obt^irf one^ data-^record. per episode* An episode began ''at. the 
initiation uf any ndw interaction either by^the teacher or by a- student* 

. Some of this things a teacher could do tb initiate an'intejact'ion^ wit^'a 
particular student; group o.f students, *or the class -were; ask a cjuestion, 

mod^l\correct usage, or give 'directions. A student^ could initiate .interactit)n 

) ^ ^ * " ' ^ • ' . 

by asking a question, for example, or could continuS an epispde of interaction. 

initiated by "the teacli^'r by ,answering a question, following instr^uctions 

(^g.,'!^o r^ad dr-ta-write on the board), practicing, 4i>d so forth. If the 

sequence of interaction continued, it could lead to further teacher^ behavior 

\ . . ^ ^ * 

* * \ ^ . . 

* in the form of borre'ctiVe feedback, modeling,, prompting, questioning^ ^ 

\ ' ' ' - ' \ . 

* Which would lead, in turn, to the studertf's second attempt to answer "^^ev-^'- 

cGrrect;Lyy to more pi;aetice, and so on. wng cha^s of* cyclical, dyadic • 

interaction^coyld thus be, and indeed ,w€fre , '^oded a6 "successiv1^^" behaviors 

In each 'episode- of. classroom J-nteraction. , \ - - : ' 

" • ; C ; \ ' . 

Our m^in interest in the analysis of the behavioral observation- data 

/• " . ■ . • " ■ • ■■ \ 

was to find,, if they o'ccurred, fairly stable and distinct patterns of class^ . 
^ Vro6tn intearc'tion* We wanted to find out if certainX teacher"" behaviors gave ' 



1 



ERIC 



rise to or were associated with certain specific student behaviors. 



Methods 



of. Aroly^ing Classroom Interaction • 



The availability of data 6n'many individual behavioral episodes made 
it possible to conduct analyses of a large number of variables, ^en though 
Only six teachers and their students welte studied. -.Several different 

^tnetho^s were ^sTed tfc determine how many patterns^ of int^^-action could be . 
found, in the observational data. These patterns were analyzed by studying 

-the association amdng.the variables. - y-- ,j 
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Suppofee^that modeling' auid practice were associated, that is, teachers 
^ho modeled also elicited, practice in the same episode* and teachers who 
used modeling infrequently also elicited practice infrequently in the same^ 
^episode* This association would be represented by a correlajtjLgn coefficient 

.such as r^= •80. /A correlation * table (matrix) is made up of numbers''of ^ 

* • * 

this kind. The numbers \d.ll— vary in size, and there will be a number for . . 

each p^ir of categories. Smaller numbers (closer tp .OQ),^mean th6 associajti 
is <^eak; the larger the numbers (closer' to + 1.00 to - l.OO), the strongej * 



the association. ■ • • % 

Factor analysis (a statistical procedure), was used to fin^ patterns .of 

association in tl::^ cprfelation matrix. A pattern found, for example, after 

^ ' , " ' ' *l v." ' 

*the teacher asks a question and the student attempts an answer, was: 

*- ' . * . 

corrective feedback, prompt,* student answers again* This, pattern was 

faund because the three .pairs 'of categories were highly associated, and 

this association would be represented in the corr-elation matrix ♦by *^ . ' 

substantial r^^s; for example: ^ ' . 

corrective feedback-proin^s: _r = .57 , • 

prompts-student answers: = -70 * 

c6trective feedback-student answers:' _r ='.62 ^ ^ j 
Corrective f eedback*'also correlates with,,teachef modeling (r .50), 
ar^: with student practice (jc , = .47). Modeling also correlates with 
student practice (r == .^3). Thus, six of ^e original variables are 
int^rcorrelated; but the factor analysis breaks these in^tercorrelations 
.into two patterns or factors.. 

Factor analytic methods , are *a quantitative way or looking = fpr these 
patterns. •The methods jnay yield none or many patterns (factors).. The 
number of factors producecj. depends on the dumber of distinct .patterns of 
. association *in the data ♦ . • ' , 



PATTERNS OF aASSROOM INTERACTION 

We found four pat.feerns of classroom interaction which characterized the 
beginning of an ei)isode. They were: ' * * ^ 

!• Teacher Model — Student: Practice ; The teacher illustrates verbally 
an English-language structure or pronounciation, Tbe-sttadent in 



turn attempts to imitate the teacher, ^ . • 

• » ' . ' . 

Teacher:- "New J_ersey," 
S tudent : "New.^ Jersey. '! 

2, .Teacher Direct — Student Read : The teacher directs the student to 

read printed material, containing .the structure being learired. 

The student in turn reads the sentence containing the structure, ^ 

Teacher: "George, would vou read the first sentence?" 
George reads: "If I had time, I ^uld go. with you." 

3, Teacher. Direct — Student Read or A sk Que.stion : this pattern is 

— \ • : ' * ^ , 

the same as the above 'pattern .exdept that the student may ask 

a questioa about the material '^o b*e xead. 

Teacher: "George would you read the first sentence?" - ^ 
George':^ "I fill in the space with the past^ tense?" 

4, Teacher Question—Student ^iswer : The teacher^sks a question; 



the student answers it. 



.Teacher: "What is the short way of saying 'I. would,' the 
, ^ " . contraction?" ^ ' 

' Student: "I'd." . * - . ^ . ' 

Tl}ese pattern^ of beginning ,an episode we^ followjed by three distinctive 
patterns of continuing the interaction.^ They were: 

* *5, Corrective Feedback— ^odel — Practice : the student- has 'responded by 
> reading (2 and 3 above), or by imitating, (1 abov®) or by -answering 



\2S 



a question (4 abovO* The <te^!lEl!fe^icorrects the student.*s response*^ 
and gives the co.rreot form* The sfe^dent tries the response again. 



Teacher: "The "short form of 'I will,' is /I'll.' I'U go 
f ^ with ypu, if I haj/e time." 
Student; "I'll go w ith you, if*I h^e time." 



6. Corrective Feedback — Prompt — S.tudent Answer ; This pattern is very 
-similar to the one above except that the teacher does not model 

^ the appropriate ifesponse. Rather he or she encourages the student 
to try the resp<Dnse, prompting him or her in* the proce3s until the 
student provides the appropriate response. 

V 

Student; "I will go to the store, tomorrow." 

Teacher; "I ?" (indicates short form with fingers) 

Student: "I'll go 'to the store tomorrow." 

7. * Teacher Question — Student Answer : (This pattern appears both 

as initiating and iii- continuing an episode. One of the 

initiating patterns has begun the episode and the student has 

fead, asked, 6t> answex^d a question. Jhe teacher then asks 

a question which the student answers. . 

Teacher; "Can you put it in the past tense?" ^ 
^ Styident: "I went to the store yesterday." 

A set of these imitiating and subsequent patterns might be 




of^these; ' ^ ' . ^^"^ 



one 

(1) Teacher Direct—Student Read., > Teacher-;Question~ , • 

Student Answer; • 

, ^ Teaclier; "George, would you read the iirst 

^ sentence?" , - , 

George read's: "If I had time, I would go with you." 
Teacherr "Can you use the shart farm of. I would?" ^ 
George; "If I had time, I'd go with you." 



















r ■ - 


* 




(2)' Teacher Model — Student Practice ^-Corrective 

'"•Feedback — Model — Practice: ^ : ' 


> » 




Teacher: "I'll go tomorrow." 
y Student:* "I '...11 go tomorrowi" ^ ' , 
'•^ . ^' 'Teacher! "O.K. But slijie it together 'more. 

- "I'll go tomorrow." ^ ^ \ 
Student: ' "I'll go tomcTrrow."' , - ' 


0 




* ^ , *' 

(3) Teacher Question — Student. Answer > Corrective. • 

Feedback — Prompt — Student ^answer : 




t 


Teacher: "How would yow mak6 it negative?" . 
,S'tudent: "I will not go tomorrow." 0 
Teacher: "O.K. But use the short form. ' • ' 

I wo. . . ' ' 
Student: "I won't go tomorrow. 




Three other patterns were found which sometimes occurred at the beginning 




of an episode and sometimes after an episode had beeri started in one of the 




% ■ ■ ■ ' : 

ways described above. These were: , o • . ~" 




8. 


*' ^ « " ^ 
Free Response: . The teacher indicates t^he structure^ but no*t * . ' 






the ideas or vocabulary. -^^ 


% 




Teacher: If I were , I could . 
* Stftdent: "If I were^ taller, T could play basketball." 




'* 9. 


Student-Student Feedback: The students prompted eath other or, one 






or more. students repeated what another student has said. 'This 






'interaction usually* occurred in Spanish. 




10. ■ 


Other: This category includes a variety of teaching activities ' 






such as games; students adding to lists of adjectives, nOun^, and 




< 


verbs on board, then making sentences *from lists; a student reading 




) 


for several minutes; small groups discussing a reading assignment 
of caftoon; student^s inaking a lisi: pf everythiirg pne has to know to 






go to the gas station or grocery store. ' ' ^r' 
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* Class'toom Differences in interaction Patterns , ' 

- Once the analyses of the patterns of behavioral' observations were 
completed, we investigated the differences in classroom behaviot patterns — 
tha^aim being t6 identify iritfefe sting* contrasts among classrooms whidh might 
account for differences in student achieveitient^ We studied the irralvidual _ 



classroom at this stage because we were interested in cliff erences among the 
teachers as well*as differences in the ways in which any given teacher might 
approach student's of various proficiency levels. We contrasted overall 
differences \ be tweeny classrooms on each pattern of interaction with the 
amount of* day-to-day variation observed within classrooms' for that pattern 
of^interaction. This analysis indicated , that teachers dif*f ered more from 

• \ ' V . . • - - • . 

eacR other than each did in their day-'to-day teaching / 

?A second analysis was performed ta find the bases on which the' classes 

• were most sharply discriminated- from each other on the average. The resuits 
oT this type of analysis (canonical discriminant function analysis) are 
port^ra^d in terms of axes, with each class" having ajtfctfre. with' respect to 
each axis. ^ ' . • , . > 

^ One'vay to describe the results of these analyses is to .portray them 
visually. Each class is represented by a point in a space defined by the . 
axes. ^ By projecting this: point onto the axes we obtain an idea of tlje 
characteristic patterns o-f- interaction in that cPass. 

In Figure 2 each classroom Is identified by a letter-^iumber combination. 
The initial letters range from A through F and, identify the six instructors. 
^ The -numbers range from 1, to 3 and refer to the proficiency level pf "the clas-s 
being taught "as measured by the John Test. The lower case letters j.dentify 



3i 



different classes at any giyen level where they ate taught by the same 

teacher, (We h,ave drawn vectors in Figure 2 to|represent how the nine 

original patterns of classroom interaction project into this space.) 

The most outstanding feature of Figure 2 is .the obvious clustering of 

classrooms taught by the ^ame £eaclier. The evidence is thus incoritrov.ertibl^ 
•: ° ' — ^ ' ^ 

that teachers have consistent and distinct ".styles" of interaction with 

students — styles^ which do not in general vary marlcedly even when teaching 

clashes of quite different yiitial ' ability level. ^ ' , * ' ^ 

The differences ybetweeA the cltassrooms as portrayed in Figure 2 may be 

understood by loT)kiilg at the^patterris ,whicli characterizfe e'ach 'quadrant. The. 

upper rigjit-hand^-quadrant is characterized mainly- by the pattern, ' "Other," 

and somewhat by /tHe^pattern, "Teael^er Direct—Student Read" (DIR^AD).' 

Pne of ' Teachi^r^*s^^asses falls in this quadrant.- 

' The upper left-hand quadrant is characterized by, "^eef^^Response" . 

(FREE). -Teachers D and E appear in this Quadrant. \ 

The lower right-hand quadrant is characterized- by the two Variations 

around "Modeling": "Corrective Feedback~Model--Prattice" (CF-M-P) and 

"Teacher Model—Practice" (MOD PRAC). One teacpr, F, appear^ in this ' 

^ * 

quadrant. - - . ' 

The lower left-hand quadrant iiiciudes the patterns of * Corrective 
Fee'dback — Promft — Answer," (CF-P-A) a,nd the "Teacher Question — Student ; 
Answer" (Q^/IND)pattem. Three- teachers appear in this quadrant. 
* ^ This figure illustrate? the characteristic style of each teacher. 

The/pattems below Axis- I reipii're . the studen^ to imitate or pract^ice 

jy.. - « ' r . - ^ - , 

those above -the axis require the student to generate responses .within a' 



struc ture. 



Consistency in style is evident' in thoge teachers who taught more 

than one class. Teacher^ uses essentially the*%ame style with all 

y ' ^ . ^ • ' * 

ree of his or her Xevel 1 classes. Teacher E, with a differeht ^tyle, 

is as consistent as Teacher F. AlthotbgtKjeac'hers B and D ^Vary their style 

•.^ ' , • ! • \* . ' * ' ♦ 

by class, th% differences are variationsHDn the same basi-c style. A)nly 

Teacher C shows remarkably different styles by' level; however, C is, the only 

teachter who had. "classes both at Level 1 arid Level 3-. 



Summary of the Results of -the 'Analysis of 
the Observation of Classroom Interaction Patterns 



At this point it will be useful to summarize the niaj[br steps in the ' * 
analysis.. The first ^ep produced nine patterns of interaction. Since these 
nine patterns Were inter^corxelated, a seconS analysis was conducted. 'Jhe 
nine patterns could be .located with respect to two axes.^ Each class could 
be described in terras of its location with, respect to these , axes and with, 
respect, to* the /Original' nine patterns. - • v ' 

The first axis contrasts two teaching paradigms; one, the "que^tion- 
aifswer-corrective feedback-prompt-answer*' style; the other, the^^direct-read" 
or ''other"* paradigm. The first paradigm is a^S'Cructured style, almost^^as if 
it yere p>rogramined. The other paradigm is less structured'^* requiring more 
^responsiveness >pn. the part, of the students. . . . . ^ * 

The second axis, cohtrasts >.a "free response" m5de with a "model-practicer 

corrective feedback-model-practice" paradigm, the most structur;eci of the 

interaction patterns. ^Thus.what this as weli as the first axis is describing 
. ' ' ' , . , \ ^ , . * . ^1^- ^ '\ , * * 

is a contrast between a more and a less structured style. ^ ^ ' ; 



Since classroom patterns are^jibt pure types in practice, a class or ' ^ ^ 
a teacher vill, have scores, that place them relative to ^ther pole**Q£ each, 
axis\ Teacher A and leacher B will be alike or deferent depending pn*whire 
they are located with resp^ect to th,eae axes* Also any one teacher, may ^ 
include other patterns within his or her overall styl^e* Pechafes< the/most m 
illuminatiHig way to think about what t\iese aijjes mean is to think bf them' as^ 
dimensions along which »a teadher wiri have a score* .Thus each teacher will 
have ^ prpfile of scores*. It* is this profile that describes each teacher's^^ 
characteristic style* * • 

, . ■% -"' ^ ■ 

\t may appear -^o the reader that the classroom interaction patterns 

. * % ^ r ^ ' V 

simply are either structured or unstructured. Such is. not literally, the 
case* There are.,three {)rara<ii§ms of structured 'instruction and two of 
unstructured instructi.on* Thes^ paradigms do not occur in pure form in 
.this s^plg" of tea(^KSrs and st*fcd^nts* r , ■ • , - 

•V s' » 1 ^ 

. ■ ■ > '.; 

• • The Reliability of Differences^ in . , ^ 

the .Patterns of Classroom Interactions ' ^ • * 

Figure' 2 illustrates the .differences among the' teachers in'^the k-inds.of 
interaction patterns that were observed in their classes* But, ;how reliable^' 
are these dif ferenc^s-^r'e ^they '"true** d^fferen.ce^ Or might the obse^rved ' 
differences be due. to wW^bserved a teacheu, or on^a^ day the teachers • 

were ohs,erved?, ' ^ , ' , • ^ * * " . 

' ' ' ' ,T " ^ ^ " \ 

Table 4 present^ the 'results of an analysi'S.perforilied to answer^ these ^ ♦ 

questions* The statistical -method wllich produce^ th^^e results is a way of . 
estimating how much of the difference'^ among the. teachers is due to sources 
which/tlJ^'ht have caused the observed differences* Upwn the left-hand- side 'ai'e 
the potential sources of the differences*^ • / ' \ , > 



TABLE 4 



Percentage of Differences in Observed Classroom Interaction 
Patterns Attributable to Potentiil Sources .of ^hese Differe^nces 



/ ' 



,Sou*rce . 
/ * Teacher 



Classroom -v 
Session' 



Episode 



OA. E.'D CF-P-A OTHER DIR READ 



16.0 



0.0. 



9.4 



1.8 



5.9' 



0.0 ^ O.O 



A* ' -ki; Alt 

15.2 .-12.7 30,1 24.4 

ii ' ■ 

68.8 77.6 68a 69.7 



5 MOD P.Ei;^C, . GF-M.-P S¥BK , QA VS Dik 



11.6 



1.-6 



33.5 



52.3 



4;6 



0.0 



11.0 



4.6 



1.5 



10. 8 



84.4 83.1 



.5 

In 8 

7.5^ 
9Q,2 



.5' 
1.0 






368 



6704' 



.1^ 

00 



p < .05 
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The ep isode is the smallest unit of analysis; episodes ^pccur within , 
' . . * ft * . * 

. * . . ^* • ♦ 

sessions . Recall that an episode is a distinct pattern of 'intefacjMon. , 

■ ■ - ' \ ■ J . ,.f . ^ 

^Sessions are the' hours of observation on different days. CXa^sroomg are' 

the, different groups taught by a teacher; ^nd teacher,, of course, rfefe^s 

" . , --^ ' » . 

^ • . ^ * . . ' 

to the individual teacher, . • . * , 

^'^Tj^^e numbers in the columns are percentages — percentages of the observeci 
differences attributable to a source of variance. ^Consider . the pattern, 
"Question-Answer-Individual" (QA IND). This pattern comprises those |] . 

performances in which th6 teacher asks an individual student question. 
Teachers vary on how much tl>ey use this performance. . Some "of this variation «' 
may be associated with efpisodes; that is, some episodes will include' this 
performance, while others, will not. Whether or not^ the perfprm^ncie appears 
may*»be'«due. to what the teacher is, trying to do at that moment. Or the " 
^vari^tion in the data 'may berWlated 'to the day or tinrS^f the petiod in^. 
which the class was observed. Or, the variatien may be related to the class 
being taught, Or,^t may^e ;r§lated to differences in teachers' styles, : 

By readiixg down' the, column under QA IND we can see what percentage ' . 
of the variance is attributable to'^each source. Thu^ epigode^ account for 
69 percent of the Variance, 15 percent is accounted for by sessions , and 
16 percent is attributable to teachers* Therefore, variation^in this ' 
performance is related, to who is being observed (teacher) .and when they are 
being observed (session). The teachers differ from each other in this 
respect; *and an individual teacher will differ in this respect from day-to-day. 
From .Table 4 it can be 'feeen that' from 53' to" 90 percent of the^tot^l . ^ 



variance of each classroom interaction patfem can be attributed to vati^tion 
J^rom interaction episode to interaction e'pisode during, the sam6 'session (day) 
of observation, Ih Tabil/e 4 we have indicated the probability levels associated 
j^ith each source. . * ' ' » : : ' . ' 



From -these results i^ny aspects <^f' variation in dlassroom interaction 
"patterns can be understood. It is clear, for instance, that only a veYy 
small and.genera^^y nqnsignificant "contribution to the variation in 
interaction patterns can be attributed to differential tre^atment of separate 
classrooms by the same teacher (see ^ine labeled Classroom in Table 4). 

• ♦ ' ' \- ^ ' • ' . ' ' . • * 

jjThe relatively large component's of v^iance for Sessions suggest that 
a niomber of these fluctuate substantially from d^y-to-day. Especially* . • 
noteworthy are *the lar§e components x)f variance for Jaiteractjdon "pat terns 
involving "free response" ^(33.9 percent)., "other"' <30^1 percent) and 
teacher "direction" (24.4 per^cent to«^33.8 percent)/ These results suggest 
that a teacher might be inclined to devote certain sessions* to til ese , - * 
"specialized" activities but refrain from^doing so in pther sess^ions. 

But, considerable session-tO'-session variance characterizes many^of 
the classroom interaction patterns. This re^lt* indicates, that each session 
of observation provides, a rather narrpw view of what is going oa in the ^ 
classroom, . • 

. In summary, differences ^among . teachers account for from . ^5 to 16 
percent ^ of the total variance in the observaSfonal data (see line labele,d^ 
Teacher in Table 4). ,The difJferences among Che 'teachers are statistically 
►significant on all- but two factors (STBK and QA VS DIR). In ordinary ^ . 
lahgOege the teachers teach dif^'ejently, and .tH^y differ most on the factors 
/'questioi^-answer — individual student"^ (QA .IND) and ^i^elrespons'e" *(FREE)« 
. . There is not much evidence that the particijlar classroom: being taught 
by a teacher ^has any influence upon the pat^rns of in^e'rac^tij^ft, wti^ ^f;^^ 
place, therein, as. we have^ seeri'^earlier in^ connection ^wJlth^ Figure 2. The 
TDLa*j<ir comporteat of overalL>» variation' in classroom interaction patjierns can 



be attributed to alternation in interaction patterns ffom episode-to-episode i 

which is not surprisijig, but session-to-session changes *also pl^y an important 

^ < ) * 

rple. Notice that session differences are statistically sigrfif icant ^on all 
nine factors, • ^ . . 

^The reader w^ll recall that the original patterns were analyzed a second 
ti^^l^^^egrouping them^ in terms of higher-order axes (represented mathematically 
by discriminant functions)/ Each teacher was given scores, called" contrajst 
scores, with respect ^lo these axi^. ' The two mo^t useful^ axes are portrayad 



in Figure 2, although four axes could have been used. 

t « » , ' 

" The question-we ask is, how reliable are these seconJP^set of scores? 

The upper porti6n of* Table 5 is set up like Table 4, but the numbers of the 

\ ' ' , 

» axes are given inst^ead of the labels for the original patterns. (Only Axes 
. I* and JEI are represented in Figure 2.) 

The upper section of Table 5 gives percentages of variance for the 
contrast scores*. -Frpm these entries we cai) see that there i^ substantial 
^ej)isode-to-episode variation in all four of the classrocftn interaction 
contrasts ^rom 58 to 86 percent of the total variance). 

Note, however, the large components of variance a'ttributjable to 

teachers. Teacher differences account for approximatley one-fpurth of the 

... ' ' 

Xotal observed variance on'eaih of the first ^wo transformed axes (I and U*). 
What ^this means,, in a practical sense, is that we could reduce, by' a 
substantial amount, our uncertlLinty about which -pole- of eitherv-eontra^t — — 
mighty appear in any given ejpisode of '"classroom interaction merely ^by knSwing 
which teacher is teaching?^ If the teacher Is high on the .first 'contrast 
(Teacher B in Figure 2), we would do well to predict *'que,st:von-answer- 



^ corrective feedback-prompt-ansver*' interaction episodes*^ On the other hand. 



9 . 
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o .TABLE'S ' ' ' ■ 

^ ' Percentage of Differences in Transformed 
Pattern Scores Attrijjutable to Sources of These Differences 



IV 



" Source 



Teacher 



ClafSsroom 



Session 



22.9 25.7 4.5 .^.0 



.8 .3 2.1 1.0 



13.4 15.8 7.1 15.1 



^ 1 EpiW . 63,0^ . 58.2\ 86.2 ^ . 79.9 



Percentages of True Score Differences in Teachers' Mean 'Contrast 
Scores Attpibutabl,e to Teachers, Classrooms, Sessions, sfnd Episodes 



Source 



H . ' ' III IV 



Teacher. ^ .-97. 2t ' ^% .-' 79.8%. 83. ^.Z, 

""^^^ClVssroom 1.5%/ .5% *16.5%. 9^% 

• S&sslon ". ■ ' 1.1% ■ 2.3% \ 5.9% 

Episode ' .2% , .2%' l-^X ^ 1".*5% 



if the teacher is low on the first contrast (Teacher F ,or perhaps E), then 

we would jdo well to predict ^'direct read" and "other episodes. * ' * < 

Even the last two aixes (^'student-student feedBack" and "direct read- 
and/or ask question vs. question-answer," respectively) show larger teacher 
and cias^sroom components of variance than do the original patterns of 
classroom interact;Lon from which they ate JLargely derived. However, ^ it 
is clear that the latter are not major contrasts in teaching styles so we - 
could not use knowledge of average teacher performance on these ,variates to 
predict much about individual episodes *of classroom interaction. 

Each teacher has a score with respect to each axis. These scores were 
averaged across all the ffays of observation.^ The resulting mean score for 
each teacher was used ia analyses of the relation- of these scores to students' 
scores. Thus the mean contrast scores ^represent how the instruction was 
organized and conducted in each teacher's class. How reliable are these 
meafi scfores?. Do they represent "true" differences among the teachers?' 

The lower section of Table 5 gives a breakdown of the weighted 
contriJ;>ution of each potential sour&e of *dif f erences^to observed variation 
^in teS'cher means for the contrast scores, that is, the ^ores with respect 
to the" axes. The f ir^t two contrasts are almost perfectly reliable indicators 
of teacher ' differences ; ^ 2^ percent of the observed variation in teacher 
toeans tan be attributed to true differences among teachers. The last tjwo . 
contrasts are somewhat sensitive to differential interaction in various 
^.^(^lassrpoms^ taught by the same teacher. , ^ 

[ This analysis shows that we are dealing with highly reliable indices - ^ > 
of teachet variation; the reliabilities of t;eachers' means range from .80 to 



• 98, But a more important feature o^, this, investigation is the evidence it 
provides that, those filassroom intera'ctiob contrasts which show differential 
treatment of different classrooms* by the same teacher are related to * " 
.differences in the ability levels ;pf tlfe* classes involved^ Whereas our 
initial interpretation of Figure 2 .holds true — teachers do have distinct 
and consistent styles of interaction*with' students — there i^ also evidence 
that certain more limited aspects o£ classroom interaction vary from 
classtoom~to~classroom taught by the same teacher. That the latter 
variation might be. in response to student characteristics will be taken 
up later., * ^ . * • ^ ' - 

A. 

• Inter-Observer, Reliability ^ ^ * 

* • ' * > * 

A fii;ial question about reliability remains befor-e we can proceed to our 

main taslc of relating student a chievem^t to teacher performances do different 
observers record the same aspect of variation in classroom interaction pcitterns 
In Order to study the. i^su^^4>f .possible observer bias,- data Were collected in 
some of the early observation sessions by pairs of independent observers 
observing tlie .same, sessions. Since three observers were used in the study, it 
was arranged to have" concurrent observation's made by eaph of the three pairs ^ 
in eight different classrooms. 

- ' ' : • . ' ^ ' ^ ^ 

In Table 6 we have summarized the results of this comparison for 
each of . the, thr^e pairs of observers, using as^the basic units of analysis 
the session for the nine original classroom interaction 'factors. Note that 
we are discussing observe?: assessment of Session-to-session variation , in these 
interaction patterns,- but we h^ve already seen from Table 5 that enough 
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TABLE 6 



Interob^erver Correlations for Nine » 
Classroom Interaction Factors (8 ^Observations] 



*Variate ^ Obs'erveif^airs 

■ ' 1 2 1 3 

CF-P-A . ^ -97 ,99 

DIR READT ^ . ,97 . . 93 . 

MOD PRAC .96 * -98 

OTHER . ..79 . ^ .99 

QA vs* DIR ' .98 -94 

'QA-IND ' ' .99 " ' , .98 

CF-M-P . ^ ^ .82 • ' .96 

SFBK I --13 , ,-A2 

FREE' * .9A .96 * 



.se&sions of observation were obtained^n the /sample to yield highly 
•reliable teacher means despite any session-tcAsession variation^. Since 

e^rs, VtV 



^ach'* classroom was visited by all observe^rs, Vthe influence of any possible 
observer biases £n classroom mean scores - is indicate^ by session-to-sessiori 
variation > which ^as we have seen, accounts for less of the variance than ^ 
teacheir. differences* (lower section of Table 5)., - 

'v^ " 

From Table 6 it can be seen t)\at session-to-session correlations 
among scores concurrently by .different observers range from ,80 to .99 ' 
with few exceptions. Thfe student-to-student feedback correlations suggest 
, that -certain observers may ^have had difficulty either recognizing or 
recording, "student-student feedBack in Spanish.'"' XKe lowest correlations 
involve Observer 2; this observer, however, made. very few observations. 
" - / ■ 

THE RELATION OF TEACHING PERFORMANCE TO STUDENT LEARW^G 

The major 'problem to be solved in the analysis of the^ student achievement 
data was to determine how .we could accoiiit for variation in posttest scores. ^ 
There were three domains of Variables which are potential predictors of 
- posttest scores: background characteristics of the students, students 
- initial level of proficiency as measured b^ the pretests, and classroom 
experiences. ^\ * 

VariabJ.es describing th^ students* backgrounds are worth considering 
as potential predictors of final achievement because thesfe measures may be- ' 
_ Indirect indicators of aptitude for learning, of academic skil%or of 
■ *prior achievement of proficiency in- English. Objjriously, the students' initial 



proficiency (the second domain mentioned' a-bove) may be associated with 
their final achievement jstatus. ^Pirfe- and posttest scores on the ^ame 
test are usually highly correlated with each other becJ&se the expefienx:e 
acquired in the interval which separates these measures does not greatly 
alter the related order of studeifcs with respect to\ their abilities; the ^ 
latter have, of course, been built wp ov^r an entire' lifetime of exp.eri&nces, 
for whicK the background measures are indicators or proxies. Nevertheless, 
the ^relations between pre-fipnd posttest scores may be altered through the 
influence of intervening events, including classroom interaction experiences. 
Classroom interactions is the^third domain of predictor ^ variables and is of 
most interest in this stu^y because it ife the only domain over which some 
degree of control can be <exercised. • " 

Other relevant experiences which might intervene between pre- and 

/ ' ■ , ■ 

posttesting (sucfh as use of English at home, 'on the 'job, and in the cpmmunity) 

unfortunately could not be objectively measured in this study. The possibility 

of controlling these extracurricular sources of exper^lence is sligtTt' in any ^ 

case, but it would be usefu\*from a theoretical point of view tp take- them - 

into- account. The best we can do ettthis pointy however, is to^be^r in 

mind that certain "background" characteristics might serve as proxies fdr V 

sustained extracurricular experiences Xe.g.,, occupational level for the ^ 

need to speak English in the "workplace; length of time in the United States 

for assimilation into an ethnic community). " . . 

Giyen tl^ese three domains of predictor variables-^^which aire organized 

in' an obvi^)us temporal sequence '(background experiences ^ pretest 

^ ^ ^^^^^^^^^^^ » . ^f^'- . . " 

perfotmance > classroom iftstru^on) , the ^lytic problem'is to find 
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how the'^nformation can 'be most parsimoniousl:^ combined to predict fj,nal 
achievement • Multiple linear regression can be applied to this task, ( . 
since the squared multi-pie corxclatitjn :(R ). between a set of predictors arid^ 
a'criterion variable -indicates^ what , proportion of^the observed variance ^li 
the criterion can b^accounted. for by a given set of predictors; 

Background characteristics must be taken into account first because 

• * A 

these variables are direct measures of c^r proxies for educational attainment, 
competence to.,cope with the processes ^of schooling, ^motivation, and aptitude. 
If such' variables account for most of the variance in final scores, then ^ 
classroom exper:lences can^have little differential influence on final status. 

Next we must consider how much initial status in. terms of pretest scores 
adds to the, prediction of outcomes beyond^what we have been able to learn 
•from a knowledge of background characteristics alone.' A related issue, here 
is how weir initial status £er ^ can be 'predicted from background character- 
istics. This 'analysis tells us how adfequate and useful 'our information 
about background experiences ia in the first Tplace. 

The final step in the re'gression analysis is to ass'ess the unique 
contribution of .classroom experiences in the prediction of fcLnal" achievement, 
above and beyond any predictive ^utility of initial status and background^ 
experiences, ' We also must determine ^whether different forms of classroom - 
'interaction appear to have^-dif ferei^t effects' upon^ achievement. Another 
purpose of relating classroom interaction to achievement is to identify any 
components of classroom interaction which may have an* impact upon specific 
forms of achievement. t ' ^* - * 

' The classroom experience variables differ fundamentally from all of 
the .other -variable^ln the-anilysis in that they 'are not individual measures, 



> , 
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but apply to all individuals in each classroom equally. The^e variables 0 

take the form of contrasts toong classrooms in_ terms of obs.erved .patterns 

of teacher-student interactipn. Every effort was made to arrive at a small 

set of independent variables Which are reliable and not too highly inter- . 

cortelated, in line with^he requirements of the multiple regression model. 

On the other haiA, the background and pretest variables are m6re error prone; 

/. ^ . 

but they only play the rolB of covariates to adjust for preexis^ting differences 

^ • . ' ^ ' ^ ^ ' ' V 

among classrooms in the final analysis. Moreover, ,these data are availably • . 

for every individual, so stable estimates of the required- regression 

'Parameters can be obtained even^with fallible measures. 

Predicting Fall and Spring Student ^ 
AchievemAnt from Student Background Characteristics 

,■■ ■ ) 1- ' , .'■ ■;■ ■ 

The backgroimd/and' achievement domains were clearly related at the lev6l 

of individual '^pairs of yaria^le's, so it was in order to see how background 

inform^ion cou^ be weighted to prfdict individual achievement scores.* It 

was also important 'to determine* how effective this 'pi;ediction caji be wh^n 

simultaneous use is maHe of all ^aAra liable background info^ation. 

Each achievement test score was predicted from the background characteristics 

using multiple linear regression. The results of these \analyses are summarized. 

in- Table 7. In that table the labels across the tops of the columns designate 

.<**'. * • 

the fall and spring achievement scores; note that ibgarithmics^transf ormations 

.> . , . . 

or the .oral proficiency scores were used. The rows of ^the^ table li's;t particular 



background characteristics used in the* regression analyses. The number'in any 

I 

cell of this matrix 'is ^the standardized regression weight for.^a particular 
baclcground variabre (row) as a predictor- of a give^achietrement score (column) • 



The line in^ Table ^7 laljeled gives the sqtlared mviltipie correlation^ 
of each achievement, test score x^ith all of the b^ackgrouiid variables, taken ^ * 
simultaneously. These numbers indicate the proportion of the variance 
in each, achievement score predicted by the complete, set of background 
characteristic variables;' for example, the backgroxind characteristic 
variables 'account for 26 per'cent t(l 26) of the variance in'the fall*" 
Decodijig 1 scores; for 13 percent (.13) of ^the , variance in the fall ^ 
Decoding 2 scores; ^for 44 percent^of thi variance in the^ John Test^ score^ • 
and so on. The probability leyels asieociated with tliese statistics are . . 
• coded with asterisks.. " ' ' ^ ' * 

In Table 7, 'under Postitests and under^Log,^ P-CTj^ no^te* the two numbers 

' . ' ■ w . ■ • - ■ " ^ ' < . ' 

with an asteWfek, .23 and^.24.© Th^se' weights ^are statistically significant, 

and appear opposite Former Job (status'l^el of job' in coi^try^ of origin) 

and Eng. in U, S, (amount of English studied in tire United States), Thus, 

^pnly two background cjharacteristics, by themselves predict the Correctness 

Score ..on the Oral Proficiency Testvrr '^1 of. th^^ckgroutrd'' characteristics 

predict^only 20 percent of tfie' varianfce ^iji^t^^, Correctnesjs^ ^'ceres. ^ But 

th^se characteristics predict 33 percent of the -Cpn^^rehension scpr.es' variants 

(see R under Eog,^ P-CP). " ".^ 

- ^ The "three Weights which are underlined in t^^.P^CT; P^'eP /mi P-ST 



CT; PteP jrtrt P-: 

- "/ - ^ ■ ' ' ■■'/■■:. 

. CO lubos^-err Table 7 are large enough to give s.ome feeling for whic^h backgroutid 
^' ^ ' * ■ ' ' ' ^ 

^factors affect proficiency scored. They are ag^^which hasta nega.tive^weight>, 
status of job in former county, *and amount of English taUen in^ the. Ui §^ 
A reasonable hypothesis from these data, .then, is that those ^students 

' ■ •'/• . ' - ■ " •• \ ■ 

more proficient in spoken English by the end of the year who are ^ 

youncer, h'ad a higher status job in their fqrmer eountcy, and have taken 

more English courses or -programs since coming *to the" United States. * 
/ \ . ^ ' 
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TABLE /7 



Standardiz'ed Rej^ression Weights, Squared Multiple Correlations and 
Statistical Tests for^ Background Characteristics as Predictors of Pretest 
" ' .'^ \ and' Fosttest Scores; Day-School Sample 







Pretests 










.Pps.ttests 
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^°?10 


^°%0 


2^10 




D.rF 
1 


D . 

2 


L-F 


J-F 


MrF ■ 


D -S 

JL 


t>-s 

i. 


L-S 


P-CT 

c 


'• P-CP 


P-ST . 


Sex 


.03 , 


— . Ui 




.03 ■ 


-.01 


-•01 


% 

-.09- . 


-.14 


.08 




' • 06 


Age 


A*. 

-.32^ 


A 

-.22 


AAA 

-.31 ■ 


-.►16 


. 03 


-,'26 


-.06 


AA 

-•.21 -=-lI 


■ A 

-•20 


-. 20 


Time in U, S. 


-.12 


.08 


. AA 

.27 




^.04 


-•14 


-.07 • 


.10 


.04 


?05 


.OA 


Former 'Job 


A 

• .22 


.10. 


* 

.21 


.13 . 


A 

.20 




.15 


'.13 


a1 

.23 


. .28 


A 

.26 


Job in S, 


.00 


-.02 


.00 


.00'. 


.08 • 


.19 


•> 

■^12 - 


.13 


-.01 


.02 


.. .-01 


C-Origin « 


-.03^ 


-.17 


-.01 


-.11 


-.16 


-.05 


.07 


-.03 


-^,02 


-.0? 


-.04 ■ 


Years Edt«:ation. 


, 05^ . 


-.02 




-.OIL 


.01 ; 


.07 


A 

.09 


0^ 
- -.09 


' .03 


.02 


,03 


Former Eng. 


.11 


.22 ■ 


A 

.22 


AA 

•iZ. 


.11 • 


.-.05 


.04 


.09 


.0.7 

J 


.'07 


. .10 


Eng. in U* S/ 


A 

.18 


•11 


AAA 

.38 


AAA 

.52 


AAA 

.37 


.11 


-.05, 




.•24 


AAA 

•li 


AA 

■ -27 


' ' ^\ • " 


• .26 


.13 


.47 


.44 


, .29 


■ .25 


.'08 


.25 


• 20 


.33 


.24 


F (9, 71) 


AA 

.2.76 


1.14 


AAA 
7:13. 


AAA 

6.25 


. A* 

3.23 


A 

2.66 


.73 


2.58 


1^94 


AAA 

3.82 


A 

2.^1 



p < .05 



p </ .01 
001 



Labels Code: 



L 
J. 
M 
P 



.Decoding, Part >1 ^ 

Decoding, Part 2 

Literacy Test 

John Test 

^lorano Test 

Oral Proficiency Test 



CT: Correctness Score 

CP? Comprehension Score 

ST: Structure Score 

F : Fall 

S : Spring 
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It shc3^3a be remSiibered that predictivfi^ackground characteristics do 

■"•*) * " . ■ . ■ ■ ■ ' ■ 

I not "cause*' higher or lower scores. Age, for example, does nol^necessarily 
jmak^ a persoir-^ss.prxrficient. But age is ^sociated with several other 
charac^ristics which, taken together, give us some idea about why age is * 
a negative" predictor of proffciency. Older students are more likely to 
have had a low status jdb .in this country^ hence, may have had less opportunity 
to speak Englislv They are more likely to have had course work in English 
* • in the previous 'country than in the U. S., hence, may have learned English 
originally as a schooJ. sttbject rather than as something to be used in their 
daj^iy lifei^etc. . ' , * 



Predicting Postt^st Scoras -Using Pretest ^ > 
Scores^>a-^Addition to B'ackgr6und Characteristics 



The next step in the analysis was to\ predict ♦the posttest scores using 

( 

information about pretest s'cores and background characteristics. The 
results'* of these analyses are 'presented in Table 8. This table is read in 
much the same way as Table 7. The predicted scores (column headings^ used 
±n this analysis were all scores taken from tests administered in the spring. 

Down the left-'hahd column -of th^ raiddlje section of Table ^ ^re listed 
the labels for the pretest scores. The first' line of this table 'gives the 
squared multiple correlations re/sulting from prediction of posttest scores 
from background charaqteristics; these numbers are repeated from the right-hand 
portion of Table 7. The entries^ in^^e line labeled, "R with Addition 
Pretests," can be conJ^^red .to the corresponding entries in the first line. 
For exaijipi^e, the R foij" predicting transformed Oral Proficiency comprehension 
scores fjrom backgrounn^^aracteristics is only .33, but with the'^ad^ition 
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TABLE 8 



Standardized Rer,ression Weights^, Squarert Multiple Correlations and 
Statistical Tests for Posttest' Scores Predicted from *Pretest :Scores 
-Adjusted for Background, .Characteristics; -Day^^^thpol Sample - 



D,-S 



L-S 



P-CT 
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P-ST 



R f rpm 
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.08 



,25 



io 



33 



.24 



D -F 
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%09 


-.-01 




-..07 - 


.07- 
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.07 


J-F 


.00 




.39 


.49 


- ;V 

.60 


' -52 


M-F 


.07 


.03 


r.QA ' 


' . 09 


-. 06 


.11 


2 

R with 
Addition 
of Pretests 


.60 


.19 


.61 


. 72 ' 


.82 


.76 

r * 


F (5^, 66) . • 
Test* of 
Info^rraation 
Increase 


*** 

11.17 

' ' 0 

v 


■ 1.72 

* 


12.23 


24.^3 


35.86*.. ? 


5^7.85^ 


p < .05 


t 

40 


y 


V 


" •4'' 




• • 



p <^01 



p< .001 



*of pretest information it becomes •82» A similar pattern is apparenti for 
the other two scores of the 6ral .Prof iciencj^ Test/ Thus, the students! 
initj.^* proficiency' plus some information abpiit. their back^und' chara.cter-^ - 
Astics account for a substantial proportion of the variance in th6i comprehension 

scores.. ^ ' * ' , -\ ./^ ^ * . V 

. It 'should be Aoted that most of' the squared .multiple correlations fox 
background characteristics plus pretest scdres are substantial (.60 to .82). 
Horedver , the " increase in ^ all of^ the R^^s except for part two £f the Decoding 
Test are highly significant when compared to prediction f rom Wckgroundr * 
characteristics alone . / flfe - ^ • 

Bosttest Scores Predicted from Classroom" Intei^action, with ^ * 7 

* Adiustment for Pretest Scores and'BacTcground Characteristics ; 

Table 9 presents information from the regresMon analyses in which 
posttest scoVes were predicted from classroom interaction contrasts, pretest 
scores'^, and background characteristics.' ^This .table^ is organized" in the same 

, V v: ^ ^ ^ ^ ^ • • . ^ ' 

way .as Table- 8% • \ ^ ... 

•2 • • • 

.»The first line of Table 9 gives R from the regression of posttest 

scores on .background' characteristics and pretest" scares, . as previously seeii in^ 
Table 8. Next are "four lines witSi Roman- numerals I through IV; within ; 



each 'line can be founcf the standardized regression weight of th;e corresponding 

"higher order" bipolar ,ebntrasts«'described earLier. ,• ^ ■ 

^ - 2'> 
The sixth Line in Table 5,' gives R onte 'the four 'higher-ord^r patterns 

of classroom interaction t(the contrasts, 'see Figure 2) ha^ve been included 

in each 4)rediy:tion eq<iation. Again, * the .lines containing the initial and 

'"final R^* values can be compared*. From t*his comparison we can see that the ^ 



TABLE 9 



Standardised Regression Weights, Squared Multiple, Correlations, ^ . .J^ 

Jf?^; and Statistical Significance Tests for Posttest Scares Predicted , * ' 

- from Cla.ssrt)om In terarct ion Contrasts, Adjusted for Student Background . 
s ^ Characteristics^and Pretest Scores; Day-School Sample 
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-IV. /- . 

' 2 ' ' ' ' 
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•25 


•3Z:'' 




-.22 


-.23. 


-.34 ■ 




.34 




rr 

** 

-.32 


.27 

* 

~ .25 


A 

•iZ 


-.18 

.io 


/• -.36^". 
.02 


.-.19 

.09 " 
< " 


1.65 


• .28 


:66 


-.76 


• ».85 •' 


.81 



F (4, 62) .Test of - • . ~ - ^ 

Information , ^ . . ' ' ' * * . . ■' 

.Increase . 2.26 2.ID3 2*'35 ,2.74 " ;2.73 . •3./^l 



ft 



""addition of classroom interaction contrasts .adds little in an absolute 

<^ ' ^ ^ ' , , , . . ' * ' ' 

sense to the accuracy 'of j)redictJLon of posttest scores (increases^ in R . * 

V vary from .04 to .09), De^ite the relatively small absolute increases 

^ in the accuracy of the prediction Obtained by supplementing background and 

, * " , \ J 

pretest information with classroom Interaction information, it can be seen 
f^p the' F-test result^ in Table 9 that the increases in predictability 
are sjtatlstic.ally significant. ^ • * ® • • 

As we .pointed out earlier," the classroom interaction contrasts apply 
equally to ^all individuals within.^each classroom, so great hQmogeneity of_ 
experiences \^ould be required in order for these contrasts to yield a large , ^ 
absolute ^ increase in^t^e ^accuracy of prediction of posttest achievement. The 
. potest results relate, ^however, 'to reXative Increases in -accuracy .qf prediction. 
These relative increases .in^^he accuracy of prediction are substantial enough, 
eveji given onr sma-11 sample size, to support further exploration of hyp^otheses 

^ ' ' ' ^ ' *' " . * ' 

about classroom interaction, , • • • 

,,. • " • • -.'..^ " . • • ■ 

.'•Th,e most, striking aspect of the pattern, of standardized rregressioi;! 

coefficients ■present.ed iii '^able 9- is that' it appears -that those features ■ 

of classroom, interaction which are associated with Mgher thaij would other- 

\ I ■ . • , _ ^^:y. — 

■m- wise be-expected posttest scpres on the Oral Proficiency Test (x.e. , axes 

• ■ . . . ' ' ■ . , , ; i 

Vl'and II)' are associated witH*lower than would othen^se b^ expectedf posttest 

>J • ^' r / ' jMcp^m on^the Literacy and Decodingf Tests "(compare the.weigh^s In the - ^ 

f- . left-hand colums-x,f Tabled o^^stk^Adr^^^^^^ 

hand .columns opposite' X and II). If we were to take ' tl^ese. coefficients 

\j. 3S- the -basis f7r formulating hypotheses about the effectiveness of individual-: 

>. rized instruction vs\ group instruction^^^the silent ^ vs. the audiolingual 

method, an -open and supportive vs. d fghly ofjanized and directive. classroom 
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climate, , then we should expect the former (indiv^||aliz''ed, supportive^ sil§nt 
way), to lead .to* i^greased oral proficiency while expecting the latter (grouped, 



directive jj audiolingual) to lead to inc?:eased literacy and decoding skills* 

It appear^, therefore, that there is a trade-off in terms of ^thetachle\;^ement 

^ 

goals-v-what appears* to be helpful for oral, proficiency appears to be 

detrimental for .literacy and deciding, and vice vewa*/ iJie same .can be said 
* « • , * t ' ■■■■■ ' #, - 

for axis HI, "student-stucient feedback, sinpe its qecurtence in a classroom , 
is predictive of lo<*7'er than might otherwise 'be' expected oral prof icienc^Jr" * » 
(mainly comprehfinsibn) but higher than might otherwise be expected literacy 
'aria decoding, . ^ , ^ - : • ^ 



Comparison of Pretest and Posttesf 
.Performance in Day-School Classroqms 



/ In ordefto study -the mean performance of individual classrooms we 
used analysis of covariance procedures* in which each pretest was the sole 

' • " •■ ■ • • " ■ 

covardate fDr ifcjs respective posttest*. The jprily, exception was for the 
Oral Proficiency Te§t, in which only the correctness score was investigated 
and both the Decoding 1 and the 'John Test were considered, individually, 

as covariates, ^ 

""^^^ • 
^ Figures 3.1 thrdugh 3r6^are plots of the 14 classroom means of pretest 

\ ..^ .0 . , ' ' * • 

scores. {hoorizohtal axis) vs. postfcest scores (vertical axis), for^the 

^h^om.-a^A.yJ^ip.o^ (the pr^ficienq^ 

means^are in the log^^ units and are plotted against John Test scores in.- 

Figure S'^A an^ fall Decoding 1 scores in Figyre J. 5 because the Proficiency 

«,>■♦• . 
Test had not been administered a5 a 'pretest). Individual clai^^rooms are 

coded' in the. figures by the same letter and number system used in ^ 



Figure 2 (page 23) • 



•'..5 



Hi 




_V^^lj^Vi4^Vf5V^j^6^l7 iH IT 22" 23^;2^''T5 " 26 27 28 29 30 31 . 

' ; . PRjElTEST " * , ^ 



> ^ ^FIGURE 3.1 

Decoding 1 ClassprfSm. Means for Fall and Sp-ring Admini^^trations, 
Day-Sf:hoo^l Sample ' (Pooled Withih-Cl^ssroonrs -r - .69; Total Sample r - ,73) 
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' Oecoding 2 -Classroom Hc^ans for Fail apd SpriuR Administrations^ 

^ Day-School' Sampld (Pooled Within-Classrooms r = ..48; Total Sample- r = .27) 
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^literacy Classroom Heans ,for FaJLl and ^Sprinn; Administration^^ 
lia/-*^ScnooX Sample (Pooled Witpin-Classrooms r = ^59; Toial Sample r = 
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%: Sp^i^S Proficiency Correctnes's Classroom Mean 
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' The line drawn ^through the points in each figure is the pooled-with^n- 
« * * . 

classiraoms regression- line^ and may* be taken as. the point of reference for 
determining -the adjus-tecl gains or losses of individual classrooms* '^The way 
to use this figure is as follows (refer to Figure -S^A): 

1, Along^the horizontal' axis are units of scores on the John Test* 

Assume that •a cl^ass had score of 20 on the John 'Test in the fair* 
2* From^ this point*, \draw a vertical line to the regression line> and 
• from where this vertical line meets the regressibn line draw a 
horizontal line to the proficiency score axis* When this procedure 
is followed, ' the horizontal line from the regression line would * 

, ' . _ . ^ 

intersect the vertical axis at about *75* 
' 3*^ This score (*75) is'^'th^ predicted scar,^ for classes whose mean 



score on the Jahn Te^t in the fall was -about 20* 



Si 



t 



4* Thus, points on^ the regression line .represent predicted spring 

scores on the'test being ' considered* ^ ' ^ 
5* , The points in the figure around the regress;Lon line* represent 



the actual scores* A*l, for example^ has fallen above the line* 
Its actual Spring s^:ore 'is better tTian would be predicted on the 
basis of the fall John Test mean for thfe^c'lass* . 
6* As can be seen^ 'some classes fall above the line (F. Ic, B*l, G*3 



l^^l^ lJTL , I , ^ . and, otjieri^) ; ^th^rs fall below (F*la, F* lb .and others)* " . . 

These figures may bfe usedT^in several dlrfigt^ttt'^ay^^ 

-> ' ^ \ . - ^» ♦ 

, , compare tha same 'clas^'on diff elrent^measurers; (2) to compare 

•different classes of J|he^ same ' teacher ; and (3)vto comp'are the 

. ' performances of classes at different levfels of praficiehcy* Using- 

Figures 3*3 and .3*4, compare the. relative positions of F*lc on 



the Lite^racy and Proficiency coi:rectness me^a^ufes. This class 
is doing better than predicted on the Proficiency measure and 
poorer on the Literacy measure. Now note in Figure 3,4^the three 



classes of teacher F; two are doing l^oorer . th^n predicted 
(t.la and F;ib) and Qne better than predict;ed (F,lc), Again 
referring ta Figure 3.4 we see that 4 of the .6 Level-^ classes , 
, \ are doing better than predicted^S out of 4 of the Level 2 classes- , . j 

and all of the' lievel 3 classes are doing as well as or better than 
/• predicted.' ' • / ' * • * . 

* ♦ r V . 

Differences in Ac hievement of^Literacy , 

' T" 7~- ■ ■ ' •'• " 

The Literacy Test scores could 'not be accounted -for solely *by the four, 
reliable classroom interaction contrasts. From Figure 3.3 ^|^see that the 
variation in these scores is ^probably due to the'ex:ceptionally good post>test 
performance of the level 1 students in classroom C,l, These students begin 
the year at the very, lowest level of performance on the Literacy Test, . * 
..but, by the end of Xhe year, tWy are as^ literate as students in several 
level 2 and level' 3 classi;ooms. . This performance contrasts'* markedly with 
that of studenft^ ill classroom B.l, where 'spr^g Litera^-y ^Test performance 
±'s essentially unchanged from that in 'the falJUL Obv^usly, teacher C is ' 
increasing, the ^.nglish language literacy of lejf,el 1 students mofe than other 

' Figure 3.1. « ^, 

— ^ . " A>\ • ■ 

Differences* in Achievement of Decoding Skills 
' • , ' / » -w. ^ — ' — \ — ' ^ 

..There are real differences among class;5;obms in terms of Decoding 2 

' . ' . , • . ' ' ' ' '\ 

scores which cannot be accounted for bj reliablej'i^f ferences in observed 

. " ^ classroom interaction patterns* Figure 3.2 |ielps clarijty what might be 

*.er|c. . • -• ■ : ■ ' w. 



,^ going^'on with Decoding 2 scores, which in part meaisures^how well students 

can iden t if sounds^ and words in English, It seems 'that certain classroom^^. 
; ill which students have the poorest relative grasp of phonemes-grapheme , ^.^ • 
4co^^Sfeisppn*dences ^in the fall are the veyy classrooms in which tlie students 
have achieved' a relatively superior grasp of these correspond^ces by the 
, ^.nd of the school year; and vice versa , y&ne obvious way\in which we- can 
filterpret these result^ is to hypothesize that teachers, in some 'sense, 
overreact to their students* ^initial abilities in Englisli pronunciation: 
if these abilities are Initially minimal, the improvement is sought; if 
these abilities are initially relatively superior, then^ther aspects of 
.performance are emphasized.^ ^ ' ' -* ; 

Differences, .in Achievement of Oral Proficjeupy 

As for the Oral Proficiency Test Qorrectness scores,; little is revealeH 
" " * ' - . ^ 

by.^ii^pectibh of Figures 3,4 and 3.5, except 'that thB. achievement%f T^vel 1 

-I — , ♦ ■ ' > . ^ 

students in classes F.la and F.lb is lower than might be^ expected. Notice, " 

I ; ' : / * : ' ' 

however, that neither the John Test nor th^ Decodiirg 1 Test is an optimum 

► predictor .for' oral proficiency. % 



The Structurie of Between- Classroom ' ' /\ ^ \ 

Variation in thd Adult ^Learning Cente^ = ' , / 

. 4:|ere^?^^ evid^ce^o^ ptMer^ strong relations betweenLstudfent. iackgrdi&d/ilLC 

performance characteriy^tics and, teachet/student^interaction factors at the 

V ' J. * . ' ' / • ' 

classroom level. We asked whether we might be ^ble to *find these relations 

at the level of individual students* ;»backgrou5id characteristics ^nd test 

scored, and the classroom interaction 'factors^- The answer is yes. 



V 
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All the informatibn obtained was used in -'one analysis: / students'^ 
: • ' 4 ' ' . 

' background charadferistics; their pre'tes't scores;-, the factor stores tor 

patterns of classroom interaction, a^d posttest scores. *^The purpose of ^ . ^ 

• - , ' ' * . 

this analysts was to ^ee' if there were di-stinctive patternsjof these domains 

of variables. The results are described by four factors in^tV^s of v^hifcU 

the- classes may be differentiated' by background) "fcla'ssroom interaction^ patterns, 

pretest performance and f^nal achievement. • ^' . 

We, found a tendency for superior Adult Learning Center classrooms to 
X contain students who' have a history of higher than average' English Study 

in 'the' U. S. / L^vel qt Former Jpb, and Educational Lev^l; while having lower 
. tharr average Age and *Level of Job in the' U. s/ We ,f ound^ an associatrLon of • 
* these characteristics with* superior performance on all initial achievement 

These students were taught with the "free response" mode of, interaction, 
as might seem appropriate for 'students of higher than average initial ability. 
"Studen^fe^tudent feedback" either di^,not occur or was not allowed; nar^was 
the "model-prab^ce-corrective feedback-modf 1-practice" paradigm-^ used. There ^ 
. Is -^/tendency for students within classrooms Vith such a high leyel of 

' \_ ^' ' - ' ' §r 

' prior training and ihitial ability not to- be asked to read or encouraged ^o ^ - 

/ t \ ' • ' ' * • , • ' * 

» *■ . - 

ask questions under direction of the teacher; on the contrary, the principal 



, pattern in, these glassrqoms is ^he question-answer intepctioh^ttejR^ ^ 
and the "free respon?e-" format of ' instruction, 4 

$ome superior classrooms contained stud'ents who had been in this country 



* 



for a relatively long while aud who were established in higher level -jobs. ,^ 
They* also had a history of Epglish study in the former- country. This second 



^ype^ of class had exceptional achievement of literacy, along with an* alMKve-average 
achievement of proficiency. One classroom interaction pattern Characteristic^ 

c 

,of 'these classes was the "direct-read and/or ask questions" interaction • 
pattern which is highly associated with posttest literacy. Other characterr . 
^^^istic classroom interaction patterns were "Othfer" and "Free," along with the 
« ^^^"^iiestion-answer-corrective feedback-prompt-answer" sequence*' ' ^ , 
^ A ^third group of superior classrooms contained well-employed women who 

V had been relatively well educated. Individuals in these classrooms, who 

i • - • • 

may haye arrived from Cuba some time ago, had superior English language . • 

tralming in their country of origin, but not necessarily in the United States, 

i Abo^e average performance on the Morano pretest characterizes.^?^is 
group. The Morano score is an indicator of gr;§mmatiical s^ill,- The Oral 
Froficiency correctness scoie al,so ha« its highest loading on.this dimension 
, as. do the posttest decodi,ng skills. This substantial ' achievement could 

well be attributed to the "high current as well as prior level of employment, 

. ' > ' * ' ' ' ' [ 

former ESL training, educational level, or sexr (female) of^ thfe individuals 

^ •= • . 

involv^, ' Two interaction patterns predominated in these classes: the "Other" ♦ 

• pattern -and the "teacher-direct-student read and/pr ask quetion" pattern.* * 

Othek: classroom interaction patTterns are deemphasized J , including "model- 

•practice"^as- welx as^ "question-'HnsWer-T^orrectiveo f eedbaclc-prbmpt-^sWer," « , 
^ ^- . ^ » . 

^ Thosa cJ.assro(5^ in which a more supportive and Indfvidualized pattefn 

of teacher-studenC interaction prevailed contained students who were recent 

* arrivals from Western Europe, pe^Sps not £oo^igliiy educated, a bit ^ 

ypurtger than average, **ana male. This meanfe, or course,, '§hat;^ehe more highly* 

structured classrooms ■(e,g,% those of^teacher F in Figure''^) "contained older 
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- females of Cuban or Carribeaa origin who have been in the United States ,^ " 

for some time. As for «est performance,' it is clear that th§- recent^ 



-J. 



arrivals from Western Europe were very deficient,. in Decoding 2 skills^. 

^\ ' ^ , . * 

(phoneme-grapheme correspondences) in t^e fall but bjecifiie exceptionally 

proficient by the end of the school year J*^ ^ . - ' , 

This analysis reveals, the complexity and richness of tn^E§L traini-ag. 
; \ ^ ' • • \ V 

.in terms of §tudBnt backg^cJund characteristics, initial test perormance, 
student-teacher interaction patterns, and fin^l achievement. The Adult, ^ 
Learning Center must be viewed as a dynamic system in which Students are ; 

.channeled into classrooms which promise to provide them with an optimal * * 
learning experience. - Th^re-are at leasj:' four ways in which (^assrooms , ^ 
can come to be above average in tlTe 'achievemeAt of English language 

^proficiency at the end of the period of instruction. If is clear.^^at initial 
proficiency as determined by the 'John Test is a good /Lcross^the^board ' 
guarantee of final proficiency, not surprisfngLy; but, among other aspects 
of pretest .performance, background characteristics and classroom interaction 
patterns must be taken* into, account iiL order to characterize fnlly the variety 
of patterns cf achievei^ent seen in differ-ent classrcotos. * o . 
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. The single most important analysis in this study ''reyealed the interaations 

; . ' : ■ , '^^^''^ ^. -•/ ' " ■.. 

among students' characteristics, their init^ial proficiency, classroom J.nter- 

action patterns*, and fiijal achievement. Some classes- performed better than 

V - ^ ^ ^ • * ' * . ^ 

others. These classes^fell intb three distinct groups in w^iiclt different 

methods of 'instructign were nised. ' - 
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Bef6re we commeiit on these arrangements. It is^impb^ant to point ^ - 

out that we are discussingHif f erentlal or r^Ktive achievement and not , 

'»'.''' . • * 

absolute achievement. All of the classes made gains in proficiency. Some, 

* . *^ ^ ' r ' " . * 

howe^^er , ' made greater gains than woUld have been predicted from their 
* , ' • ' . 

initial,. scores.. We were able to differentiate among these classes in terms 
of the students* cliaracteristics, th,eir initial proficiency and the classxgom 
patterns of interaction* 

^^j ^ One type of class of above average achievement , was t3rpically composed o^. 
younger students, whg had attained a' higher educatsion level, had sti^idied 
more English in' the United States, and who in 'their native country had held 
higher status jobs. 'This type o£ class had higher than average. Oral 
Proficiency correctness scores, but lower scores on the m^ajsure of phonic 
skills (decoding 2). They were largely taught in the "fr^e respdnse**' mode' 
which meant that .the students were encouraged to .generate' English statements.^ 
The interaction pattern is characterized by^the teacher ask?!^ a question 
and the studen^t answering or also asking questions. , , ' . 

- , ; ' ' ' • # 

A second type of class was composed of .students who had .been in ^his 



..country for a longer time, who had studied more English in their native 
country^, and held higher level jobs i^^his country. These students achieved 
betteir than^^jerage prof iciency 'and performed exceptionalJly well on the 
literacy mea?ui;e. They were taught largely in the "direct-read and/or ask 
questions" pattern in i/hich the teacher directs the students to re^d some-" 
.thing and ask ^questions about it or the students ask .questions." The teacher 
works from a .set of materials that forp the basis for the questions and 
answers. The teachers of these classes also used the "Other" and "Free 
•response" and the "Question-answer-corrective feedback-prcmpt-answer" modes. 
These varia'^tions reflect the use of different strategies. within a context of 
talking abouU materials. * ' ' ' ' . 
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i A.thircf group was composed of females, who had higher stafus jobs, ' 
who* Were relatively better educated, were from Cuba, had been here longer, . 
•and who had studied more^* English In their native country* Their performance 
was sqperior on all measures that required correct usage — the Oral Proficiency 
correctness^ scale, the Morano, and the Decoding Tests. They were taujght 
largely^l^n^the "Other" mode and the "teacher direct-student read and/or asjc 

question" mpdes. * ^ ^ 

^* * * • ♦ 

These differences suggest a hypothesis. Assume that some t^acherS had 

chosen the appropriate methods for t^he type of student. Then the hypothesis 

is that, proficiency is increased to*the degree .that the appropriate method 

i6 chosen for^^the type p^tudent. ' While this conclusion is hardly s'tartling, 

guides for practical action are a|>parent in the data. The .three types^ *" 

' . ' ' ' - ~ / . 

described above comprise the majority of , students in the Adulf Learning . 

. I 

Center. 'Preslimably the easiest way to. adap.t;m"ethods to types of students 

4 - ' t * I * . . 1 t_ 

i$ to organize blasses in terms of the students' characteristics and to have 

teachers use ''the methods appropriate to th^ type of class. 



Thfe^ Center presently places Students in classes on the basis of ^ their 

^ leyel^.oi^prof iciencj as j^sured^ b^ the^ Jo^hn Te,st^_^JL£ important to note f _ 

that it is not the initial level of proficiency that alone determines how ^ p 
much additional proficiency is achieved . 'If appropriate methods are used 
in relation tO| the students' characteristics, greater than expected proficiency 
is achieved. We recommend, therefore: 
rf. • 1,. That- students* be placed in Classes in terms of th.exr 

'-'^rinitial proficiency and that they also.be groupied within * ./ ' %> 
'\ levelsS)f' prof iciency, as'^much' as possible, by common 

^ background characterist4.cs, and , in clusters like those . 

. 4' ^ ' ^ ^ * • • # ' ' * . 

. ^ * ' described above. * 

♦ ' . ' • ' . *■ ' ''''' "^^^'^ " '-'^r. : 
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2» That teachers be assigned*to these classes whose teaching . 
Style is appropriate for the type /of student. 

This'*! second point needs some additional explanation^ The variations , 
on the audiolinguaX^iaethod have limited ef f ectiveng.ss for the types of '% 
students attending the Center. In some of the first analyses tTie interactions 
characteristic 6f this method were associated with greater achievement. But, 

.r. ■• ' • ■ ■ ' ■ " 

.when we analyzed the interaction patterns in conjunction with -the students' 
-» 

charaCte.ristics, it appea'red that* interaction patterns requiring motfe free 
responding^ were "more effective*, particularly with students who had studied 



some ^^^Enplish (and again irrespective of the actual level of prof iciency) • 

The reader has undoubtedly noticed the frequency with which tbe "Other" 
interaction pattern appeared significant in these analyses. When we examined 
the variety' of specific instances in this category, piany of them seemed to 
require the student to generate language,, to think about the language (for 
example^,'' sotting words into their grammatical categories), and to use the 
language for reading and discussion. This category and "ftee response" 
appear frequently as significant interacfion patternS;.particularly in 

• " '. • - • 

conjuntcioa with students* characteristics. ,The activities in Xhese .cat^egories 

'7 \ . ' / " ^ ' 

seem to have in common increasing the frequency with which students use the , 

J^guageV. not- by imitating it but by generating ixl • . . 

A practical plan might be to use the variaans oh 'the audioJ,ingual method^ 

with' students who have the least p;cof iciency , biit even, then to mix it' with 

^the other ' iiiit^raction pajitems as quickly as possible. Perhaps the next type 



of inter^action pattern to use after *some minimal proficiency has been acq^uired 

r 



,;-*is the fqrm of . the ."Teacher-direct--student read and/or ask questions." This 



• * 

type* of procedure Seems to be a* way of helping students to use the language 

' * • <. ^ ' 

natuMlly. But the purpose of tising these ^procedures should be to bring 

, ' . . * (. ». 

* the students to free responding. « , *** J 

It is clear that no one method or teaching performance is uniformly 

effective. One cannot really take sides in^ an audiolingual vs. "silent^ 

m way" debate on methodology since the effective patterns of teacher behavior 

cut across th^ elements of both. This conclusion is particul^Xy important 
'h * ^ 

because the teachers tend to use a consistent styled The effects of this 

consistency wers apparent in the analysis of different classes of the same 

teacher. One class of a teacher achieved better than predicted; another, 

taught in th^ same way, did less well than predicted. Only when, we analyzed 

the interaction patterns with the student characteristic's data did we find 

I* 

that methods >probably must be**adapted to specific, characteristics of the . ' 

students.. , , ^ - - ^ 

The regression anal^Ses indicated that students' characteristics j/ere ^ 

major predictor o^ their Wbsequent achievement. This factor cannot be 

ignored if one wishes to make the system of instruction even more effective*. 

' We are not implying that th^^ Center's teachers d^iot adapt to the type of ^ c 

class; some do; some have selected the appropriate method for the cla$s whicnf 

they are teaching. But obviously there were classes for whictj^^ifetf? instructicjnal 

methods were inappropriate or less effective. Given t^iarirthe .Center/ s teachefrs 

. work closely with their students, it 5eems likely that 'giving, the teachers wore 

^^information about their students (such as that provided by the c(ues tionnairi^^ 

developed for this study), and learning "which procedures 'are mote "effective * 

with certain types of studerits may be suffici^ent to increase the effectiveness 

" ' ' . ♦ , ' ' * . . 

of the system markedly. ^ ' . ' ^ / 



^ The reader should recall that this -study was not an evaluation of 
the Center.* It was an intensive, in-depth\ study of the students and- ^ 
teachers of the Center to find /^ut how^b^fWto organize instructioit. 
The results have provided sora^ hypo theses on which plans of action may 

0 

be built^ ' , * ' , • - • . / 



